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MP ■ 1 Introduction and overview 

> 

^ ' 1.1 Motivations 

o\ 

■ Let Z he a random variable whose law is absolutely continuous with respect to the Lebesgue 

, measure (for instance, Z is a standard Gaussian random variable or a Gamma random vari- 

able). Suppose that {Z„ : n 5^ 1} is a sequence of random variables converging in distribution 
^ ■ towards Z, that is: 

for all z£R, P{Zn ^ z) — > P{Z ^ z) as n ^ oo. (1.1) 

' It is sometimes possible to associate an explicit uniform bound with the convergence (jl.lj) . 

^ providing a global description of the error one makes when replacing P{Zn ^ z) with P{Z ^ z) 

for a fixed n ^ 1. One of the most celebrated results in this direction is the following Berry- 
Esseen Theorem (see e.g. Feller |17| for a proof), that we record here for future reference: 



Theorem 1.1 (Berry-Esseen) Let {Uj)j>i be a sequence of independent and identically dis 



trihuted random variables, such that E{\Uj\^) = p < go, E{Uj) = and E{Uj) = . Then, 
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by setting Zn = ^— 7^ X^"=i Uj, n ^ 1, one has that Z, 
moreover: 



Law 



Z ~ o/K(0,l), as n ^ 00, and 



'n 



sup|P(Z„ ^ 



3/9 



(1.2) 



a- 



The aim of this paper is to show that one can combine Malliavin calculus (see e.g. [35| ) 
and Stein's method (see e.g. [H]), in order to obtain bounds analogous to (II. 2p . whenever the 
random variables Zn in p.ip can be represented as functionals of a given Gaussian field. Our 
results are general, in the sense that (i) they do not rely on any specific assumption on the 
underlying Gaussian field, (ii) they do not require that the variables Z„ have the specific form 
of partial sums, and (iii) they allow to deal (at least in the case of Gaussian approximations) 
with several different notions of distance between probability measures. As suggested by the 
title, a prominent role will be played by random variables belonging to a Wiener chaos of 
order g (g ^ 2), that is, random variables having the form of a multiple stochastic Wiener- 
Itd integral of order q (see Section [2] below for precise definitions). It will be shown that 
our results provide substantial refinements of the central and non-central limit theorems for 
multiple stochastic integrals, recently proved in [33] and [37]. Among other applications and 
examples, we will provide explicit Berry-Esseen bounds in the Breuer-Major CLT (see [5]) for 
fields subordinated to a fractional Brownian motion. 

Concerning point (iii), we shall note that, as a by-product of the flexibility of Stein's 
method, we will indeed establish bounds for Gaussian approximations related to a number of 
distances of the type 



where is some suitable class of functions. For instance: by taking = {h : ^ l}, 

where ||-||^ denotes the usual Lipschitz seminorm, one obtains the Wasserstein (or Kantorovich- 
Wasserstein) distance; by taking = {h : ||/i||_bl ^ 1}> where IHI^^ = + |Mloo, one 
obtains the Fortet-Mourier (or bounded Wasserstein) distance; by taking equal to the 
collection of all indicators 1_b of Borel sets, one obtains the total variation distance; by taking 
Jif equal to the class of all indicators functions l(_oo,2]) G IR, one has the Kolmogorov 
distance, which is the one taken into account in the Berry-Esseen bound p.2p . In what 
follows, we shall sometimes denote by (iw(-i-)) ^^fm(-)-)) ^^tv(-)-) and dKoi(-i-)) respectively, 
the Wasserstein, Fortet-Mourier, total variation and Kolmogorov distances. Observe that 
dwi-i-) ^ dpui-,-) and dTy{.,.) ^ dKoii-,-)- Also, the topologies induced by dw, c?TV and 
c^Kol are stronger than the topology of convergence in distribution, while one can show that 
dpM metrizes the convergence in distribution (see e.g. [TU Ch. 11] for these and further results 
involving distances on spaces of probability measures). 

1.2 Stein's method 

We shall now give a short account of Stein's method, which is basically a set of techniques 
allowing to evaluate distances of the type (|1.3|) by means of differential operators. This theory 
has been initiated by Stein in the path-breaking paper [48], and then further developed in 
the monograph [IS]. The reader is referred to [TT], [33] and [H] for detailed surveys of recent 
results and applications. The paper by Chatterjee [8] provides further insights into the existing 
literature. In what follows, we will apply Stein's method to two types of approximations. 



d,%^{X,Y) = sup {\E{h{X)) - E{h{Y))\ : heJ^} 



(1.3) 
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namely Gaussian and (centered) Gamma. We shall denote by o/K(0, 1) a standard Gaussian 
random variable. The centered Gamma random variables we are interested in have the form 

F{u) ^= 2G{u/2) -u, u>0, (1.4) 

where G{v/2) has a Gamma law with parameter i>/2. This means that G{v/2) is a (a.s. 

strictly positive) random variable with density g{x) = '^r(i^/2) (0,00) (3^)1 where T is the usual 
Gamma function. We choose this parametrization in order to facilitate the connection with 
our previous paper [33] (observe in particular that, if ^ 1 is an integer, then F{i>) has a 
centered distribution with u degrees of freedom) . 

Standard Gaussian distribution. Let Z ~ o/f^(0, 1). Consider a real-valued function h : 
M — > M such that the expectation E{h{Z)) is well-defined. The Stein equation associated with 
h and Z is classically given by 

h{x) - E{h{Z)) = f'{x) -xf{x), x£R. (1.5) 



A solution to p.Sp is a function / which is Lebesgue a.e.-differentiable, and such that there 
exists a version of /' verifying (II. 5p for every x S M. The following result is basically due 
to Stein [HI HO]. The proof of point (i) (whose content is usually referred as Stein's lemma) 
involves a standard use of the Fubini theorem (see e.g. [47] or [HI Lemma 2.1]). Point (ii) is 
proved e.g. in [111 Lemma 2.2]; point (iii) can be obtained by combining e.g. the arguments 
in [IHl p. 25] and [HI Lemma 5.1]; a proof of point (iv) is contained in [iQl Lemma 3, p. 25]; 
point (v) is proved in [8j Lemma 4.3]. 

Lemma 1.2 (i) Let W be a random variable. Then, W Z ~ ^{0, 1) if, and only if, 

E[f'{W)-Wf{W)]=0, (1.6) 

for every continuous and piecewise continuously dijferentiable function f verifying the 
relation E\f'{Z)\ < 00. 



(ii) If h{x) = l(-oo,z] (2^); z GM, then il.5\} admits a solution f which is bounded by v27r/4, 
piecewise continuously differentiable and such that ||/'||oo ^ 1- 



(iii) If h is bounded by 1/2, then il.^) admits a solution f which is bounded by \J vr/2, 
Lebesgue a.e. differentiable and such that ||/'||oo ^ 2. 

(iv) If h is bounded and absolutely continuous (then, in particular, Lebesgue-a.e. differen- 
tiable), then has a solution f which is bounded and twice differentiable, and such 
thatWfW^ ^ ,/^\\h-E{h{Z))\\^, ll/'IU ^2||/i-E(/i(Z))||oo and\\f"\U^2\\h'\\^. 

(v) If h is absolutely continuous with bounded derivative, then ^.5\) has a solution f which 
is twice differentiable and such that ||/'||oo ^ 1 1 ^'11 00 and ||/"||oo ^ 2||/i'||oo. 

We also recall the relation: 

2dTv(^, y) = snv{\E{u{X)) - E{u{Y))\ : ||^z||oo ^ !}■ (1.7) 

Note that point (ii) and (iii) (via (|1.7p ) imply the following bounds on the Kolmogorov and 
total variation distance between Z and an arbitrary random variable Y: 

dKox{Y,Z)^ sup \E{f'{Y)-Yf{Y))\ (1.8) 

/6.-?Kol 

dTv{Y,Z)^ sup \E{f'{Y)-Yf{Y))\ (1.9) 
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where ^koI and ^tv are, respectively, the class of piecewise continuously differentiable func- 
tions that are bounded by ^/2Tr/4 and such that their derivative is bounded by 1, and the 
class of piecewise continuously differentiable functions that are bounded by \/vr/2 and such 
that their derivative is bounded by 2. 

Analogously, by using (iv) and (v) along with the relation ||/i||l = ll^'lloo, one obtains 

dFM{Y,Z)^ sup \E{f'{Y)-Yf{Y))\, (1.10) 
dwiY,Z)^ sup \E{f'iY)-Yf{Y))\, (1.11) 



where: =^fm is the class of twice differentiable functions that are bounded by v27r, whose 
first derivative is bounded by 4, and whose second derivative is bounded by 2; is the 
class of twice differentiable functions, whose first derivative is bounded by 1 and whose second 
derivative is bounded by 2. 

Centered Gamma distribution. Let F{iy) be as in (|1.4p . Consider a real- valued function 
/i : M — > M such that the expectation E[h{F{i'))] exists. The Stein equation associated with h 
and F{i^) is: 

h{x)-E[h{F{u))]=2{x + u)f'{x)-xf{x), xG(-z/,+oo). (1.12) 



The following statement collects some slight variations around results proved by Stein [49], 
Diaconis and Zabell [15], Luk [26], Schoutens [46] and Pickett [41]. It is the "Gamma coun- 
terpart" of Lemma 11.21 The proof is detailed in Section [71 

Lemma 1.3 (i) Let W be a real-valued random variable (not necessarily with values in 
{—ly, +00) ) whose law admits a density with respect to the Lebesgue measure. Then, 

W F{u) if, and only if, 

E[2{W + v)+f'{W)-Wf{W)] = Q, (1.13) 

where a-|_ := max(a,0), for every smooth function f such that the mapping x 1— > 2(x + 
v)j^f'{x) — xf{x) is bounded. 

(a) If \h{x)\ ^ cexp(aa;) for every x > —u and for some c > and a < 1/2, and if h is twice 
differentiable, then S1.1S\) has a solution f which is bounded on (— i^, -|-oo), differentiable 
and such that \\f\\oo ^ 2||/i'||oo and ||/'||oo ^ ||^"||oo- 



(Hi) Suppose that v ^ 1 is an integer. If \h{x)\ ^ cexp(ax) for every x > —u and for 
some c > and a < 1/2, and if h is twice differentiable with bounded derivatives, 
then has a solution f which is bounded on {—Uj+oo), differentiable and such that 

, ^ ■s/2TT/i'\\h\\oo and \\f'\\oo ^ \/^T^\\h' \\oo ■ 



Now define 



J^i = {he : ||/i||oo ^ 1, ||/i'||oo ^ 1}, (1.14) 

^2 = {/iG"^;? : ||/i||oo ^ 1, ||/i'||oo ^ 1, ||/i"||oo ^ 1}, (1.15) 

=^1,^ = M{^'€'^(y) (1.16) 

^2,u = ^2n'^^iu) (1.17) 
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where "^"^ denotes the class of twice differentiable functions (with support in M) and with 
bounded derivatives, and '^'^{y) denotes the subset of "^"^ composed of functions with support 
in (— I/, +00). Note that point (ii) in the previous statement implies that, by adopting the 
notation (II. 3p and for every > and every real random variable Y (not necessarily with 
support in ( — z^, +00)), 

d^,,„(y,F(z.))^ sup \E{2{Y ^v)r{Y)-Yf{Y)\\ (1.18) 

where ^2,v is the class of differentiable functions with support in (— i/, +00), bounded by 2 
and whose first derivatives are bounded by 1. Analogously, point (iii) implies that, for every 
integer z/ ^ 1, 

d^,^^(y,F(z.))< sup \E{2{Y ^y)r{Y)-Yf{Y)\\, (1.19) 

where is the class of differentiable functions with support in (— i^, +00), bounded by 

■sJ'l'K jv and whose first derivatives are also bounded by ■sj2'K jv . A little inspection shows 
that the following estimates also hold: for every 1/ > and every random variable y, 

d^,{Y,F(y)) ^ sup |s[2(y + zv)+/'(y)-y/(y)]| (1.20) 

where ^2 is the class of functions (defined on M) that are continuous and differentiable on 
M\{i/}, bounded by max{2,2/z/}, and whose first derivatives are bounded by max{l,l/z/ + 
2/1/^}. Analogously, for every integer ^ 1, 

d^i(y,F(i/)) ^ sup |i?[2(y + z.)+/'(y)-y/(y)]|, (1.21) 

where ^\ is the class of functions (on M) that are continuous and differentiable on ]R\{z^}, 
bounded by max{ y27r/i/, 2/z^}, and whose first derivatives are bounded by max{y^27r/i/, l/i^+ 

2/.n. 

Now, the crucial issue is how to estimate the right-hand side of (|1.8j) - (|l.lip and (jl.lSI) - 
(|1.2ip for a given choice of Y . Since Stein's initial contribution [IH], an impressive panoply 
of techniques has been developed in this direction (see again [10] or [l3] for a survey; here, 
we shall quote e.g.: exchangeable pairs [IS], diffusion generators [Sllin], size-bias transforms 
|20| . zero-bias transforms [21], local dependency graphs [10] and graphical-geometric rules 
[8]). Starting from the next section, we will show that, when working within the framework 
of functionals of Gaussian fields, one can very effectively estimate expressions such as (|1.8|) - 
(II. lip . (|1.18p and (I1.19P by using techniques of Malliavin calculus. Interestingly, a central role 
is played by an infinite dimensional version of the same integration by parts formula that is 
at the very heart of Stein's characterization of the Gaussian distribution. 



1.3 The basic approach (with some examples) 

Let be a real separable Hilbert space and, for g ^ 1, let S)^'' (resp. ^®'^) be the qth tensor 
product (resp. qth symmetric tensor product) of ^. We write 

X = {X{h):heS)} (1.22) 
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to indicate a centered isonormal Gaussian process on Sj. For every q ^ 1, we denote by Iq 
the isometry between ^®'^ (equipped with the norm • W^jSiq) and the qth Wiener chaos 
of X. Note that, if is a cj-finite measure space with no atoms, then each random variable 
Iq{h), h G ^®'^, has the form of a multiple Wiener-Ito integral of order q. We denote by 
L^(X) = 'L?{Q.,a{X),P) the space of square integrable functionals of X, and by B^'^ the 
domain of the Malliavin derivative operator D (see the forthcoming Section [2] for precise 
definitions). Recall that, for every F G D^'^, the derivative DF is a random element with 
values in ^. 

We start by observing that, thanks to (ll.6|l . for every h £ S) such that \\h\\f) = 1 and for 
every smooth function /, we have E[X (h) f {X (h))] = E[f' {X{h))]. Our point is that this last 
relation is a very particular case of the following corollary of the celebrated integration by- 
parts formula of Malliavin calculus: for every Y £ D^'^ with zero mean, 

E[Yf{Y)] = E[{DY, -DL-'Y)^f'{Y)], (1.23) 

where the linear operator L^^ is the inverse of the generator of the Ornstein-Uhlebeck semi- 
group, noted L. The reader is referred to Section [2] and Section [3] for definitions and for a full 
discussion of this point; here, we shall note that L is an infinite-dimensional version of the 
generator associated with Ornstein-Uhlenbeck diffusions (see [35l Section 1.4] for a proof of 
this fact), an object which is also crucial in the Barbour-Gotze "generator approach" to Stein's 
method ^\19\. 

It follows that, for every Y G D^'^ with zero mean, the expressions appearing on the right- 
hand side of (frH]l - (frTT] ) (or (frT5]) - (fOTD ) can be assessed by first replacing Yf{Y) with 
{DY, —DL~^Y)sjf'{Y) inside the expectation, and then by evaluating the distance between 
1 (resp. 2Y + 2i^) and the inner product {DY, —DL~^Y)^. In general, these computations are 
carried out by first resorting to the representation of {DY, —DL~^Y)^ as a (possibly infinite) 
series of multiple stochastic integrals. We will see that, when Y = Iq{g), for g ^ 2 and 
some g G 9)^1, then {DY, -DL-^Y)^ = q-'^\\DYf^. In particular, by using this last relation 
one can deduce bounds involving quantities that are intimately related to the central and 
non-central limit theorems recently proved in [37], [36] and [33| . 

Remark 1.4 1. The crucial equality E[Iq{g)f{Iq{g))] = E[q-^\\DIq{g)\\lf {Iq{g))], in the 
case where / is a complex exponential, has been first used in [36], in order to give 
refinements (as well as alternate proofs) of the main CLTs in [37] and [39]. The same 
relation has been later applied in [33], where a characterization of non-central limit 
theorems for multiple integrals is provided. Note that neither [33] nor [36] are concerned 
with Stein's method or, more generally, with bounds on distances between probability 
measures. 

2. We will see that formula p.23|l contains as a special case a result recently proved by 
Chatterjee [H Lemma 5.3], in the context of limit theorems for linear statistics of eigen- 
values of random matrices. The connection between the two results can be established 
by means of the well-known Mehler's formula (see e.g. [2H Section 8.5, Ch. I] or 
[351 Section 1.4]), providing a mixture- type representation of the infinite-dimensional 
Ornstein-Uhlenbeck semigroup. See Remarks 13.61 and 13.121 below for a precise discus- 
sion of this point. See e.g. [3l] for a detailed presentation of the infinite-dimensional 
Ornstein-Uhlebeck semigroup. 
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3. We stress that the random variable {DY^ —DL^^Y)^ appearing in (11.231) is in general 
not measurable with respect to o"(y). For instance, if X is taken to be the Gaussian 
space generated by a standard Brownian motion {Wt : t ^ 0} and Y = hih) with 
h G L2([0, 1]2), then DtY = 2 h{u,t)dWu, t e [0,1], and 

(i)y,-z)L-iy)L2([o,i]) = 2h{h^i /i) + 2||/i||2,(p^^j,) 

which is, in general, not measurable with respect to aiY) (the symbol h®ih indicates 
a contraction kernel, an object that will be defined in Section 2). 

4. Note that (11.231) also implies the relation 

E[Yf{Y)]=E[T{Y)f'{Y)l (1.24) 

where t{Y) = E[{DY, —DL^'^Y) ^\Y]. Some general results for the existence of a real- 
valued function r satisfying (I1.24P are contained e.g. in [6|. Note that, in general, it 
is very hard to find an analytic expression for riY), especially when 1" is a random 
variable with a very complex structure, such as e.g. a multiple Wiener-Ito integral. On 
the other hand, we will see that, in many cases, the random variable {DY, —DL^^Y)^ 
is remarkably tractable and explicit. See the forthcoming Section [6], which is based on 
[491 Lecture VI], for a general discussions of equations of the type (ll.24p . See Remark 
13.101 below for a connection with Goldstein and Reinert's zero bias transform 1201 . 



5. The reader is referred to [42] for applications of integration by parts techniques to the 
Stein-type estimation of drifts of Gaussian processes. See [23] for a Stein characterization 
of Brownian motions on manifolds by means of integration by parts formulae. See |13j for 
a connection between Stein's method and algebras of operators on configuration spaces. 

Before proceeding to a formal discussion, and in order to motivate the reader, we shall 
provide two examples of the kind of results that we will obtain in the subsequent sections. 
The first statement involves double Wiener-Ito integrals, that is, random variables living in 
the second chaos of X. The proof is given in Section [7l 



Theorem 1.5 Let (^n)ra^i be a sequence belonging to the second Wiener chaos of X. 

1. Assume that E{Z^) 1 and E{Z^) 3 as n ^ oo. Then Zn ^—>- Z ~ ^(0,1) as 

n — > oo. Moreover, we have: 



dMZn, Z) ^ 2^j\\E{Zt) - 3| + ^±|i^ \e{ZI) - 1|. 

2. Fixu > and assume that E{Zl) 2u and E{Z^) - l2E{Zl) 12i/2 - 48i/ as n ^ oo. 

Then, as n ^ oo, Zn ^—>- F{v), where F{u) has a centered Gamma distribution of parameter 
V. Moreover, we have: 

d,^^{Zn,F{u)) 

^ max{l, l/i/, 2/v''} ^jh^E{Zi)-l2E{Zl)-l2u^ + 1^ ~ \E{Ziy^\, 
where J^2 is defined by 111.15]} . 
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Note that, in the statement of Theorem 11.51 there is no mention of MalHavin operators (how- 
ever, these operators will appear in the general statements presented in Section EJ. For 
instance, when applied to the case where X is the isonormal process generated by a fractional 
Brownian motion, the first point of Theorem II. 51 can be used to derive the following bound for 
the Kolmogorov distance in the Breuer-Major CLT associated with quadratic transformations: 

Theorem 1.6 Let B he a fractional Brownian motion with Hurst index H G (0,3/4). We set 

= 1 ^ (|t + 1|2^^ + \t- 1|2^^ - 2|t|2^)' < OO, 



and 

z_ = 



^ n— 1 

Zn = J= J2 ("'""(^(fc+D/n - 5fc/n)' " l) , n ^ 1. 



k=0 



Then, as n — > OO, Zn — * Z ~ o/K(0, 1). Moreover, there exists a constant ch (depending 
uniquely on H) such that, for any 1: 



dKoliZn,Z)i^ i.,3 om - (1-25) 



Note that both Theorem 11.51 and 11.61 will be significantly generalized in Section [3] and Section 
m (see, in particular, the forthcoming Theorems 13.11 [3TTT] and I^TT]) . 

Remark 1.7 1. When H = 1/2, then i? is a standard Brownian motion (and therefore has 
independent increments), and we recover from the previous result the rate that 
could be also obtained by applying the Berry-Esseen Theorem I l.li This rate is still valid 
for H < 1/2. But, for H > 1/2, the rate we can prove in the Breuer-Major CLT is v?^~2 . 

2. To the authors knowledge. Theorem 1 1.61 and its generalizations are the first Berry-Esseen 
bounds ever established for the Breuer-Major CLT. 

3. To keep the length of this paper within limits, we do not derive the explicit expression of 
some of the constants (such as the quantity ch in formula (|1.25|) ) composing our bounds. 
As will become clear later on, the exact value of these quantities can be deduced by a 
careful bookkeeping of the bounding constants appearing at the different stages of the 
proofs. 



1.4 Plan 

The rest of the paper is organized as follows. In Section [2] we recall some notions of Malliavin 
calculus. In Section [3] we state and discuss our main bounds in Stein-type estimates for func- 
tionals of Gaussian fields. Section H] contains an application to the Breuer-Major CLT. Section 
[5] deals with Gamma-type approximations. Section [6] provides a unified discussion of approx- 
imations by means of absolutely continuous distributions. Proofs and further refinements are 
collected in Section [7l 
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2 Elements of Malliavin calculus 



The reader is referred to [2S] or [3S] for any unexplained notion discussed in this section. As 
in p.22p . we denote hy X = {X{h) : h £ S)} an isonormal Gaussian process over S). By 
definition, X is a centered Gaussian family indexed by the elements of S) and such that, for 
every h,g£S), 

E[X{h)X{g)]={h,g)^. (2.26) 
As before, we use the notation L^(X) = L^(r2, cr(X), P). It is well-known (see again [33 



Ch. 1] or [25]) that any random variable F belonging to L^(X) admits the following chaotic 
expansion: 

oo 

F = Y.W<i), (2-27) 

where /o(/o) := E[F], the series converges in and the symmetric kernels fg S iD®'', <? ^ 1, are 
uniquely determined by F. As already discussed, in the particular case where S) = L^(A, £/, //), 
where {A, s?/) is a measurable space and /x is a (j-finite and non-atomic measure, one has that 
= l1{A'^ , , fi'^'^) is the space of symmetric and square integrable functions on A'^. 
Moreover, for every / G ij®"^, the random variable Ig{f) coincides with the multiple Wiener- 
Ito integral (of order q) of / with respect to X (see [35l Ch. 1]). Observe that a random 
variable of the type Ig{f), with / € i^®'', has finite moments of all orders (see e.g. [251 Ch. 
VI]). See again [3H Ch. 1] or [45] for a connection between multiple Wiener-Ito and Hermite 
polynomials. For every g ^ 0, we write Jg to indicate the orthogonal projection operator on 
the qth Wiener chaos associated with X, so that, if F G L^(r2,^,P) is as in (|2.27|) . then 
JgF = Igifg) for every g ^ 0. 

Let {ck, A; > 1} be a complete orthonormal system in ij. Given / € and g £ i^®'', for 
every r = 0, . . . ,p A q, the rth contraction of / and g is the element of Sj^iP+'}-'^^) defined as 

oo 

f®rg= ^ (/, Cj^ (X" . . . ei^)jj»r (9,ejj (g) . . . (g) ei^)jj»r. (2.28) 
n,...,ir=l 

Note that, in the particular case where = L"^ {A, £/ , fj,) (with fi non-atomic), one has that 

f ®r 9 = / fih, tp_r, Si,...,Sr) g{tp_r+l, tp+q-2r, Si,..., Sr)dfl{si) . . . d^{Sr). 

Moreover, f ®o g = f ® g equals the tensor product of / and g while, for p = g, f ®p g = 
{f,g)fj<g>p. Note that, in general (and except for trivial cases), the contraction / 0^ 5 is not, a 
symmetric element of ^®(P+'?~2r) rpj^^ canonical symmetrization of / (g^ <7 is written f®rQ- 
We also have the useful multiplication formula: if / G S)®^ and g G ij®*^, then 

IpU)Iq{9) =Yj\r) [rJ^P+i'^rif^rg). (2.29) 

Let ^ be the set of all smooth cylindrical random variables of the form 

F = g{X{4>i),...,X{(t)r,)) 
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where n ^ 1, g : ^ M. is a smooth function with compact support and (pi G Sj. The 
Malhavin derivative of F with respect to X is the element of L^(r2,^) defined as 

" Pi 

i=l * 

In particular, DX{h) = h for every h £ S). By iteration, one can define the mth derivative 
D"^F (which is an element of L^(0, ij®™)) for every m ^ 2. As usual, for m ^ 1, D™'^ denotes 
the closure of ^5^ with respect to the norm || • \\m,2, defined by the relation 

m 

\\FC,2 = E[F'] +Y,E[\\D'F\\l^,]. 

i=l 

Note that, if F / and F is equal to a finite sum of multiple Wiener-Ito integrals, then 
F G D"^'^ for every m ^ 1 and the law of F admits a density with respect to the Lebesgue 
measure. The Malliavin derivative D satisfies the following chain rule: if : M" — > M is in 
(that is, the collection of continuously differentiable functions with a bounded derivative) and 
if {-Fj}i=i,...,n is a vector of elements of D^'^, then ^{Fi, . . . ,Fn) S B^'^ and 

DipiFi, . . . = E ^(Fi, . . . , Fn)DFi. 

i=l * 

Observe that the previous formula still holds when is a Lipschitz function and the law of 
(Fi, . . . , F„) has a density with respect to the Lebesgue measure on M" (see e.g. Proposition 
1.2.3 in [35]). 

We denote by 6 the adjoint of the operator D, also called the divergence operator. A 
random element u £ L'^{Q,S)) belongs to the domain of 6, noted Dom5, if, and only if, it 
satisfies 

\E{DF, u)sj\ ^ Cu ||F||l2 for any F G ^, 

where c„ is a constant depending uniquely on u. If u E DomiJ, then the random variable 6{u) 
is defined by the duality relationship (customarily called "integration by parts formula"): 

E{F6{u)) = E{DF,u)^, (2.30) 

which holds for every F G D^'^. One sometimes needs the following property: for every 
F G D^'^ and every u £ Dom6 such that Fu and F5{u) + {DF,u)^ are square integrable, one 
has that Fu G Dom(5 and 

5{Fu) = F5{u) - {DF, u)^. (2.31) 

The operator F, acting on square integrable random variables of the type (|2.27p . is defined 
through the projection operators { Jg}g>o as L = Yl'^=o ~'lJqi is called the infinitesimal 
generator of the Ornstein-Uhlenbeck semigroup. It verifies the following crucial property: a 
random variable F is an element of DomL (= D^'^) if, and only if, F G DomJF (i.e. F G D^'^ 
and DF G Dom5), and in this case: 6DF = —LF. Note that a random variable F as in (|2.27p 
is in B^'^ (resp. B^'^) if, and only if, 

oo oo 

^QllfqWlei < OO (resp. ^q'^WfqWle, < oo), 

q=l q=l 
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and also = Z^g^i 9||/g||^0g. If = L"^ {A, ssf , fi) (with fi non-atomic), then the 

derivative of a random variable F as in (|2.27l) can be identified with the element of L'^{A x $7) 
given by 

oo 

DaF = Y,Ql<i^i{M-,a)), aeA. (2.32) 

9=1 

We also define the operator L~^, which is the inverse of L, as follows: for every F G L^(X) 
with zero mean, we set L~^F = '^Zq^i ~\'^q{^)- Note that is an operator with values 
in B^'^. The following Lemma contains two statements: the first one (formula (|2.33|) ) is an 
immediate consequence of the definition of L and of the relation 5D = —L, whereas the second 
(formula (|2.34p ) corresponds to Lemma 2.1 in [33] . 

Lemma 2.1 Fix an integer q ^ 2 and set F = Iq{f), with f G Then, 

6DF = qF. (2.33) 

Moreover, for every integer s ^ 0, 

E{F'\\DF\\l) = ^— ^(F"+2). (2.34) 



3 Stein's method and integration by parts on Wiener space 
3.1 Gaussian approximations 

Our first result provides explicit bounds for the normal approximation of random variables 
that are Malliavin derivable. Although its proof is quite easy to obtain, the following statement 
will be central for the rest of the paper. 

Theorem 3.1 Let Z ~ ^(0, 1), and let F G B^'^ be such that E{F) = 0. Then, the following 
hounds are in order: 

d^{F,Z) ^ E[{1- {DF,-DL-^F)^fY'^, (3.35) 
dFM{F,Z) ^ AE[{l-{DF,-DL-^F),,ff'^. (3.36) 

//, in addition, the law of F is absolutely continuous with respect to the Lebesgue measure, one 
has that 

dKoi{F,Z) ^ E[{l-{DF,-DL-^F)^f]^/\ (3.37) 
dTYiF,Z) ^ 2E[{1- {DF,-DL-'F)^f]'^\ (3.38) 

Proof. Start by observing that one can write F = LL~^F = —5DL~^F. Now let / be 
a real differentiable function. By using the integration by parts formula and the fact that 
Df{F) = f'{F)DF (note that, for this formula to hold when / is only a.e. differentiable, one 
needs F to have an absolutely continuous law, see Proposition 1.2.3 in [35]), we deduce 

E{Ff{F)) = E[f'{F){DF, -DL-^F)^]. 

It follows that E[f'{F) - Ff{F)] = E{f'{F){l - {DF, -DL~^F)^)) so that relations 
(|3.38p can be deduced from p.8p - (|l.lip and the Cauchy-Schwarz inequality. 
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□ 

We shall now prove that the bounds appearing in the statement of Theorem 13.11 can be 
explicitly computed, whenever F belongs to a fixed Wiener chaos. 

Proposition 3.2 Let q ^ 2 be an integer, and let F = Iq{f), where f G Sj'^'^ . Then, 
{DF,-DL-^F)^ = q^^\\DF\\l, and 

E[{1 - {DF, -DL-^F)^f] = E[{1 - q-^\\DF\\lf] (3.39) 

q~l 

= {l-qm\l^,? + q^Y.^2q 

r=l 

9-1 

r=l 

Proof. The equality {D F, - D L^^ F) = q^'^\\DF\\l is an immediate consequence of the 
relation L~^Iq[f) = —q~^Ig{f). Prom the multiplication formulae between multiple stochastic 
integrals, see (|2.29p . one deduces that 

\\D[Iqif)]\\l = qql ||/|||«, + g2 1^ (r - 1)!^^ " {f^rf) (3.42) 

(see also [36l Lemma 2]). We therefore obtain (|3.40|) by using the orthogonality and isometric 
properties of multiple stochastic integrals. The inequality in (|3.4ip is just a consequence of 
the relation Wf^rfUf^mii-r) ^ ||/ (8)r f\\f,m(<i~r). □ 

The previous result should be compared with the forthcoming Theorem 13.31 where we 
collect the main findings of [36] and [37]. In particular, the combination of Proposition 13.21 
and Theorem 13.31 shows that, for every (normalized) sequence {F„ : n ^ 1} living in a fixed 
Wiener chaos, the bounds given in ()3.35p - (|3.36|l are "tight" with respect to the convergence 
in distribution towards Z ~ ^(0, 1), in the sense that these bounds converge to zero if, and 
only if, Fn converges in distribution to Z. 

Theorem 3.3 ( |36L 137) ) Fix q ^ 2, and consider a sequence {Fn : n ^ 1} such that Fn = 
Iqifn), n ^ 1, where fn G S)®'^ . Assume moreover that E[F^^ = ql\\fn\\\(g,q 1. Then, the 
following four conditions are equivalent, as n —> oo.- 

(i) Fn converges in distribution to Z ^(0, 1); 

(ii) E[F^] - 3; 

(iii) for every r = 1, q-1, (g)^ fn\\sj(S2(g-r) 0; 

(iv) WDFnWl ^ q in\?. 

The implications (i) (ii) <-> (iii) have been first proved in [37] by means of stochastic 
calculus techniques. The fact that (iv) is equivalent to either one of conditions (i)-(iii) is 
proved in [36]. Note that Theorem 13.11 and Proposition 13.21 above provide an alternate proof 
of the implications (iii) — > (iv) — > (i). The implication (ii) (i) can be seen as a drastic 
simplification of the "method of moments and cumulants", that is a customary tool in order 
to prove limit theorems for functional of Gaussian fields (see e.g. [SJ EJ dHl EZl EU]). In [HH] 
one can find a multidimensional version of Theorem 13.31 



2r)!(r - 1)!^ 
2r)!(r - 1)!^ 



J \mrf\\%^ 



2{q-r) 



q-1 
r — 1 



11/ 'S^r /||^®2{9-r) • 



(3.40) 
(3.41) 
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Remark 3.4 Theorem 13.31 and its generalizations have been apphed to a variety of frame- 
works, such as: p- variations of stochastic integrals with respect to Gaussian processes [21 [12], 
quadratic functional of bivariate Gaussian processes [H], self-intersection local times of frac- 
tional Brownian motion [24] . approximation schemes for scalar fractional differential equations 
|32| . high-frequency CLTs for random fields on homogeneous spaces [291 EOj [38] , needlets anal- 
ysis on the sphere [1], estimation of self-similarity orders [55], power variations of iterated 
Brownian motions [31]. We expect that the new bounds proved in Theorem 13.11 and Propo- 
sition 13.21 will lead to further refinements of these results. See Section [4] and Section [5] for 
applications and examples. 

As shown in the following statement, the combination of Proposition 13.21 and Theorem 
13.31 implies that, on any fixed Wiener chaos, the Kolmogorov, total variation and Wasserstein 
distances metrize the convergence in distribution towards Gaussian random variables. Other 
topological characterizations of the set of laws of random variables belonging to a fixed sum 
of Wiener chaoses are discussed in [25], Ch. VI]. 

Corollary 3.5 Let the assumptions and notation of Theorem \3.S\ prevail. Then, the fact 
that Fn converges in distribution to Z ^ -^(0, 1) is equivalent to either one of the following 
conditions: 

(a) dKoi(^n, Z) 0; 

(b) dTYiFn,Z)^0; 

(c) dwiFn,Z)^0. 

Proof. If Fn Z then, by Theorem 13.31 we have necessarily that ||DF„,||^ — > (7 in L^. The 
desired conclusion follows immediately from relations (|3.35p . (|3.37p . (|3.38l) and (I3.39p . □ 

Note that the previous result is not trivial, since the topologies induced by d^oi, d^y and 
are stronger than convergence in distribution. 

Remark 3.6 {Mehler's formula and Stein's method, I). In [H Lemma 5.3], Chatterjee has 
proved the following result (we use a notation which is slightly different from the original 
statement). Let Y = g{V), where V = (Vi,...,^^) is a vector of centered i.i.d. standard 
Gaussian random variables, and (7 : M" ^ M is a smooth function such that: (i) g and its 
derivatives have subexponential growth at infinity, (ii) E{g{V)) = 0, and (iii) E{g{V)^) = 1. 
Then, for any Lipschitz function /, one has that 

E[Yf{Y)]=E[S{V)f'{Y)], (3.43) 

where, for every v = {vi, u„) G M", 

dt, (3.44) 

so that, for instance, for Z ~ o/>^(0, 1) and by using p.9p . Lemma [L2] (iii), (|1.7|) and Cauchy- 
Schwarz inequality, 

dTv(Y, Z) « 2E\{S{V) - (3-45) 



dg , .dg 



i=l 
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We shall prove that (I3.43P is a very special case of (ll.23p . Observe first that, without loss 
of generality, we can assume that Vi = X{hi), where X is an isonormal process over some 
Hilbert space of the type = L'^{A,£/,fi) and {/ii, /i„,} is an orthonormal system in 
Sj. Since Y = giVi, . . . ,Vn), we have DaY = Yl^=i '§§'(^)^ii^)- the other hand, since 
Y is centered and square integrable, it admits a chaotic representation of the form Y = 
J2q>i This implies in particular that DaY = ^^^i qlq-i{^q{a, •)). Moreover, one has 

that -L-^Y = J2g^^lWq), so that -DaL-^Y = Eg^i Vi(V'g(a, •))■ Now, let T„ z ^ 0, 
denote the (infinite dimensional) Ornstein-Uhlenbeck semigroup, whose action on random 
variables F G L^(X) is given by Tz{F) = ^q^^e''^^ Jq{F). We can write 

Jo ^jHi/Vt)(^-^)dt = e-^T^[DaY)dz = Y,-Jq-i{DaY) 

= Y,Iq^i{%{a,-)) = -DaL-^Y. (3.46) 

qr^i 

Now recall that Mehler's formula (see e.g. [351 formula (1.54)]) implies that, for every function 
/ with subexponential growth, 

T,{f{V)) = E[fie-'v + Vl^^V)]l^y, OO. 

In particular, by applying this last relation to the partial derivatives i = l,...,n, we 
deduce from (|3.46|) that 

l! ^ ^Hi/Vt)iDaY)dt = ^^h,ia)£^^E[^ytv + Vl^tV)]dt 1^^. 

Consequently, (I3.43P follows, since 

{DY,-DL-'Y)^ = + U^.^ 

= S{V). 

□ 

See also Houdre and Perez-Abreu [22] for related computations in an infinite-dimensional 
setting. 

The following result concerns finite sums of multiple integrals. 

Proposition 3.7 For s ^ 2, fix s integers 2 ^ qi < . . . < Qg. Consider a sequence of the 
form 

s 

Zn = Y.IqAfn), n > h 

1=1 

where G Sj®"* . Set 

= {(^,J» G {1, . . . ,s}^ X N : \ i^r -^qiKqj and {r,qi,qj) / {qi,qi,qi)} ■ 
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Then, 

E[il - {DZn,-DL-^Zn)^f] ^ 2 -Y^^qi\\\rjlr,,}j 



In particular, if (as n ^ oo) E[Zl] = YA=i1i^-\\fn\\\mi — ^ 1 ""'^ «/; for any i = 1,... ,s 



! ||2 
II llf,i»qi 



and r = 1, . . . ,gj — 1, one /las i/iai fnW^'s^^'.ii-^) — ^ > then ^ ~ =^(0, 1) as 



n — > oo, anc? i/ie inequalities in Theorem \3.1\ allow to associate hounds with this convergence. 

Remark 3.8 1. In principle, by using Proposition 13.71 it is possible to prove bounds for 
limit theorems involving the Gaussian approximation of infinite sums of multiple inte- 
grals, such as for instance the CLT proved in pH Th. 4]. 

2. Note that, to obtain the convergence result stated in Proposition 13.71 one does not 
need to suppose that the quantity E[Iq{fiY] = Qj'll/^ll^®,^ is convergent for every i. 
One should compare this finding with the CLTs proved in [39], as well as the Gaussian 
approximations established in 



Proof of Proposition [3.71 Observe first that, without loss of generality, we can assume that 
X is an isonormal process over some Hilbert space of the type = L"^ {A, £/ , fi) . For every 
a G ^, it is immediately checked that 

s 

Z),Z„ = ^(?,/,,_i (/;(•, a)) 

i=l 

and 

-D,{L-'Z,-,) = D, =^/,^_i (/;(,«)). 

\i=i * / i=i 

This yields, using in particular the multiplication formula (I2.29P : 

{DZn,-DL~^Zn)9, 

s QiAqj-l / _ -\\ / _ -\\ / f \ 

= E^^ E "-'X r )\ r J W-2-2r(^y^ /;(•,«) ®r/ii(-,aHrfa)j 

s qiAqj-1 _ i\ / _ i\ 

= E^^ E -'('V r% w--(/:®^H-i/^) 

ij=l r=0 ^ ^ ^ ^ 

= E E - 1 1 V..-^..-- ifn fl) 

i=l {i,j,r)e^ ^ ^ ^ ^ 
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Thus, by using (among others) inequalities of the type (ai + . . . + a^,)^ ^ w(af + . . . + a^), the 
isometric properties of multiple integrals as well H/^rfi'll ^ ||/ g\\, we obtain 

E{[{DZn,-DL-'Z„)s^-l]^) 
< 2 l-J^gJI 



fi ||2 
/nil 



i=l 



lf)®9i I 

i=l / 



^ 2 

V i=i 



\ 2 



^ 2 



i=l 



X||/n "^gi-r /nlU»2r||/^ '^qj-r /nlU®2r, 

the last inequality being a consequence of the (easily verified) relation 

l|/n /nll^®<7i+9j-2r = (/n ®gi-r /n; fn ®qj-r fn)s}^^^- 



□ 



3.2 A property of {DF, -DL-^F)^ 

Before dealing with Gamma approximations, we shall prove the a.s. positivity of a specific 
projection of the random variable {DF, —DL~^F)^ appearing in Theorem 13.11 This fact will 
be used in the proof of the main result of the next section. 

Proposition 3.9 Let F G D^'^. Then, P-a.s., 

E[{DF,-DL-^F)sj\F] ^ 0. (3.47) 

Proof. Let 5 be a non-negative real function, and set G{x) = g{t)dt, with the usual 
convention Jj^ = — for rr < 0. Since G is increasing and vanishing at zero, we have 
xG{x) ^ for all x € M. In particular, E{FG{F)) ^ 0. Moreover, 

E[FG{F)]=E[{DF,-DL~^F)f,g{F)]=E[E[{DF,-DL~^F)^\F]g{F)]. 

We therefore deduce that 

E[E[{DF,-DL-^F)^\F]1a]'^ 

for any cr(F)-measurable set A. This implies the desired conclusion. 
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□ 



Remark 3.10 According to Goldstein and Reinert [20], for F as in the previous statement, 
there exists a random variable F* having the F-zero biased distribution, that is, F* is such 
that, for every absolutely continuous function /, 

E[f'{F*)]=E[Ff{F)]. 

By the computations made in the previous proof, one also has that 

E[g{F*)] = E[{DF,-DL-'F)^g{F)], 

for any real-valued and smooth function g. This implies, in particular, that the conditional 
expectation E[{DF,-DL-'^F)f,\F] is a version of the Radon-Nikodym derivative of the law 
of F* with respect to the law of F, whenever the two laws are equivalent. 

3.3 Gamma approximations 

We now combine Malliavin calculus with the Gamma approximations discussed in the second 
part of Section 11.21 

Theorem 3.11 Fix v > and let F{u) have a centered Gamma distribution with parameter 
u. Let G G B^'^ he such that E{G) = and the law of G is absolutely continuous with respect 
to the Lebesgue measure. Then: 

d,%i{G,F{v))^K2E[{2u + 2G-{DG,-DL-^G),,ff/\ (3.48) 

and, if u ^ 1 is an integer, 

d^i (G, F{u)) ^ KiE[{2u + 2G- {DG, -DL-^G)^f\^'\ (3.49) 

where M{ and M2 are defined in (TA^ - (T1^) . Ki :=max{Y^27r/z^, l/u + and K2 := 

max{l, l/u + 2/i/2}. 

Proof. We will only prove (|3.48j) . the proof of (|3.49j) being analogous. Fix > 0. Thanks to 
(|1.2Qp and p.23|) (in the case Y = G) and by applying Cauchy-Schwarz, we deduce that 

d^^,{G,F{v)) ^ sME[nG){2{u + G)+-{DG,-DL-^G)^)]\ 

^ K2X E[{2{u + G)+ - {DG, -DL-^G)f,fYl^ 
^ K2 X E[i2iu + G) - {DG, -DL-^G)^ff'\ 

where the last inequality is a consequence of the fact that E[{DG, —DL'~^G)^\G] ^ (thanks 
to Proposition [33]). □ 

Remark 3.12 {Mehler's formula and Stein's method, II). Define Y = g{V) as in Remark 
13.61 Then, since (|3.44|) and (I3.45P are in order, one deduces from Theorem 13. Ill that, for every 
u>0, 

d,^,{Y, F{v)) ^ K2E[{2u + 2Y- S{V)f]^'\ 
An analogous estimate holds for dj^j, when applied to the case where ^ 1 is an integer. 
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We will now connect the previous results to the main findings of [33]. To do this, we shall 
provide explicit estimates of the bounds appearing in Theorem 13.111 in the case where G 
belongs to a fixed Wiener chaos of even order q. 

Proposition 3.13 Let q ^ 2 be an even integer, and let G = Iq{g), where g G S^®'^ . Then, 

E[{2u + 2G- {DG, -DL-^G)sjf] = E[{2u + 2G - q-^\\DG\\lf] (3.50) 
^ i2i^-q\\\g\\l^,f + 

+q^ (2g-2r)!(r-l)!2('^^|') lb 0r sll J,«2(.-.) + 



r£{l q-1} 



-4q\ \\cg^ X g(E>q/2g-g\ 



where 



(?/2)!(J,"„\)' {qmKq%f 
Proof. By using (|3.42p we deduce that 

q-^\\DG\\%-2v-2G = [q\\\9\\lm-2u) + 

+ q (^-l)'(rj) Hq-r)[g®rg) + 



(3.51) 



re{l,...,9-l} 



+q{q/2 - 1)! (^J^ ^^Iq{g®q/2g - 2g). 



The conclusion is obtained by using the isometric properties of multiple Wiener-Ito integrals, 
as well as the relation ||fl'®r5||f|®2{g-r) ^ \\g (dr 5'||^»2{g-r) , for every r G {1, q — 1} such that 
r + q/2. □ 

By using Proposition 13.131 we immediately recover the implications (iv) (iii) — > (i) in the 
statement of the following result, recently proved in [33l Th. 1.2]. 

Theorem 3.14 (|33|) Let u > Q and let F{u) have a centered Gamma distribution with 
parameter v . Fix an even integer q ^ 2, and define Cq according to (3. 51\) . Consider a 
sequence of the type Gn = Lq{gn), where n ^ 1 and gn G Sj®"^ , and suppose that 

lim E[GI] = lim g!||5„||fi®9 = 2z/. 

Then, the following four conditions are equivalent: 

(i) as n ^ oo, the sequence {Gn)n^i converges in distribution to F(u); 

(ii) lim„^oo E[Gt,] - 12E[Gl] = I2u^ - 48i/; 

(iii) as n ^ oo, — 2gG„ — > 2qv in 1? . 

(iv) lim„^oo \\gn^q/2gn " Cg X = 0, whcrc Cq is given by I3.51\) . and lim^^oo lls'n ®r 
9n\\sj?}2(Q~r) = 0, for every r = 1, ...,q — 1 such that r ^ q/2. 
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Observe that E{F{uf) = 2u, E{F{vf) = and E{F{vf ) = ASv + Uu"^ , so that the 
imphcation (ii) — > (i) in the previous statement can be seen as a further simphfication of 
the method of moments and cumulants, as apphed to non-central hmit theorems (see e.g. 
|51| . and the references therein, for a survey of classic non-central limit theorems). Also, the 
combination of Proposition 13.131 and Theorem 13.141 shows that, inside a fixed Wiener chaos 
of even order, one has that: (i) metrizes the weak convergence towards centered Gamma 
distributions, and (ii) metrizes the weak convergence towards centered distributions 
with arbitrary degrees of freedom. 

The following result concerns the Gamma approximation of a sum of two multiple integrals. 
Note, at the cost of a quite heavy notation, one could easily establish analogous estimates for 
sums of three or more integrals. The reader should compare this result with Proposition 13.71 

Proposition 3.15 Fix two real numbers vi,V2 > 0, as well as two even integers 2 ^ qi < q2. 
Set u = U1+U2 and suppose (for the sake of simplicity) that q2 > 2qi. Consider a sequence of 
the form 




E[{2Zn + 2iy- {DZn, -DL"^Zn)^f] 




2 



A\fn®q^-r fn\\f)»^A\fi®qj-r fiW f,®2r . 



In particular, if 




(Hi) for any i = 1,2 and r = 1, . . . ,gj — 1 such that r ^ ^, ||/^ 0^ fnW fym(qi-r) — > as 



n — > 00, 



then Zn as n ^ 00, and the combination of Theorem \3.1\ and liS. 52) allows to 

associate explicit bounds with this convergence. 



Proof of Proposition 13.151 We have (see the proof of Proposition 13. 7p 



{DZn,-DL-^Zn)^-2Zn-2u 




ifn^rfi). 
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Thus 



E {[{DZn, -DL-'Zn)^ - 2Zn - 2uf) 



LV — 


\ ^ „ III fi 
2^ Qi-\\jn 




1=1,2 










2u - 






1=1,2 



+ 24Ec-^.!||/>V2/n-%x/, 

1=1,2 



i ||2 
nil 



j=l,2 
2 



12 E ,?(-•- (,.+,,-2 



'3i + 'J,-2r 



i ||2 

nllf)®9i 



j=l,2 



+12 E ^'(^-1) 



1=1,2 



X||/^ ®gi-r /nlU^arll/i^ ®gj-r /nllfl®2r. 



□ 



4 Berry-Esseen bounds in the Breuer-Major CLT 

In this section, we use our main results in order to derive an exphcit Berry-Esseen bound for the 
celebrated Breuer-Major CLT for Gaussian-subordinated random sequences. For simplicity, 
we focus on sequences that can be represented as Hermite-type functions of the (normalized) 
increments of a fractional Brownian motion. Our framework include examples of Gaussian 
sequences whose autocovariance functions display long dependence. Plainly, the techniques 
developed in this paper can also accommodate the analysis of more general transformations 
(for instance, obtained from functions with an arbitrary Hermite rank - see [52]), as well as 
alternative covariance structures. 

4.1 General setup 

We recall that a fractional Brownian motion (fBm) B = {Bt : t € [0,1]}, of Hurst index 
H £ (0,1), is a centered Gaussian process, started from zero and with covariance function 
E{BsBt) = RH{s,t), where 

Rnis, t) = i {t'^ + s'^ - \t - sD ■ s,tG [0, 1]. 

If if = 1/2, then RH{s,t) = min(s,t) and is a standard Brownian motion. For any choice 
of the Hurst parameter H G (0, 1), the Gaussian space generated by B can be identified with 
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an isonormal Gaussian process of the type X = {X{h) : h ^ S)}, where the real and separable 
Hilbert space 9) is defined as follows: (i) denote by S the set of all M-valued step functions 
on [0,1], (ii) define ^ as the Hilbert space obtained by closing S with respect to the scalar 
product 

(l[0,t]i l[0,s])j5 = RH{t,s). 

In particular, with such a notation one has that Bt = X(ljo,j])- Note that, if H = 1/2, 
then = L2[0,1]; when H > 1/2, the space S) coincides with the space of distributions 

f such that S2~^J^Q^ ^ {f{u)u^~'i ){s) belongs to L^[0, 1]; when H < 1/2 one has that S) is 

H-- 

-^0+ ^(-^^[O'l])- Here, =/q_,_ ^ denotes the action of the fractionaJ fiiemaim-LiouviJJe operator, 
defined as 

^o~h{x) = fix - yf-lf{y)dy. 

The reader is referred e.g. to [35] for more details on fBm and fractional operators. 
4.2 A Berry-Esseen bound 

In what follows, we will be interested in the asymptotic behaviour (as n — > 00) of random 
vectors that are subordinated to the array 

Vn,H = {n^(5(fc+i)/n - Bk/n) ■ k = 0, n - 1}, I. (4.53) 

Note that, for every n ^ 1, the law of Vn,H in (|4.53l) coincides with the law of the first n instants 
of a centered stationary Gaussian sequence indexed by {0,1,2,...} and with autocovariance 
function given by 

pH{k) = ^{\k + 1|2^ + \k- 1|2^ - 2|A:|2^), kGZ 

(in particular, Ph{^) = 1 and puik) = pn^—k)). From this last expression, one deduces that 
the components of the vector Vn^H are: (a) i.i.d. for H = 1/2, (b) negatively correlated for 
H G (0,1/2) and (c) positively correlated for H € (1/2, 1). In particular, if i7 G (1/2, 1), then 
^kPHik) = +00: in this case, one customarily says that pn exhibits long-range dependence 
(or, equivalently, long memory - see e.g. [53] for a general discussion of this point). 

Now denote by i^^, g ^ 2, the qth Hermite polynomial, defined as 

, , (-1)" ^ di _^ 
Hq{x) = - — r-e 2 - — e 2 , X e M. 
q\ dxi 

For instance, H2{x) = (x^ — l)/2, H^{x) = {x^ — 3x)/Q, and so on. Finally, set 



and define 

k=0 ^' k=0 



= E^.K(%-+1)/" - Bk/n)) = E^.(€;n)> (4-54) 
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where Iq denotes the gth multiple integral with respect to the isonormal process associated 
with B (see Section EJ. For simplicity, here (and for the rest of this section) we write J^/^ 
instead of \k/n,{k+i)/n]^ also (5®^'^ = ^k/n® ' ' ' ® ^k/n (q times). Note that in (|4.54|) we 
have used the standard relation: q\Hq{h) = Iq{h®^) for every h £ such that \\h\\fj = 1 (see 
e.g. m Ch. 1]). 

Now observe that, for every q ^ 2, one has that J2t \PH{'t)\'' < oo if, and only if, H G 
(0, ^^^). Moreover, in this case, E{Z'^) — > 1 as n — > oo. As a consequence, according to 
Breuer and Major's well-known result [H Theorem 1], as n ^ oo 

Z„ — > Z ~ ^(0, 1) in distribution. 

To the authors' knowledge, the following statement contains the first Berry-Esseen bound ever 
proved for the Breuer-Major CLT: 

Theorem 4.1 As n — > oo, Zn converges in law towards Z ~ (0, 1). Moreover, there exists 
a constant ch, depending uniquely on H , such that, for any n ^ 1; 

sup \P{Zn ^Z)- P{Z ^ z)| ^ C// X 



Remark 4.2 1. Theorem ll.6l (see the Introduction) can be proved by simply setting q = 2 
in Theorem 14.11 Observe that in this case one has = ^5^0 that the middle line in 
the previous display becomes immaterial. 

2. When H > the sequence Z„ does not converge in law towards a Gaussian random 
variable. Indeed, in this case a non-central limit theorem takes place. See Breton and 
Nourdin [3] for bounds associated with this convergence. 

3. As discussed in [S, p. 429], it is in general not possible to derive CLTs such as the one in 
Theorem 14.11 from mixing-type conditions. In particular, it seems unfeasible to deduce 
Theorem l4.1l from any mixing characterization of the increments of fractional Brownian 
motion (as the one proved e.g. by Picard in [40j Theorem A.l]). See e.g. Tikhomirov 
[M] for general derivations of Berry-Esseen bounds from strong mixing conditions. 



n 2 



2' 2f/-2J 
2g-3 2g-l ^ 



4.3 Proof of Theorem [4Jl 

We have 



oH-- "-l 



1 



k=0 

hence 
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By the multiplication formula (|2.29|) : 

q-l 



-—n V / 



r=0 

Consequently, 



r=0 ^ ■ ^ fc/=0 

Thus, we can write 



-\\DZn\\l-l = Y,Ar{n)-l 

r=0 

where 

>2 „_l 



We will need the following easy Lemma (the proof is omitted). Here and for the rest of the 
proof of Theorem 14.11 the notation o„ ^ bn means that sup„^]^ |«n|/|^n| < oo. 

Lemma 4.3 1. We have pnin) ^ \n\'^^~'^ . 
2. For any a G M, we have 

n-l 

,0 + 1 



k=l 



3. If a £ ( — oo, —1), we have 



k=n 



By using elementary computations (in particular, observe that {Sk/n:^e/n)sj = PH{k — i)) 
and then Lemma BTSl it is easy to check that 



n-l 

Vi(n)-1 = -^n"^''-'Y.(^k/n,Se/n)l-l 

" ^ k,l=0 
n-l 



1 / 1 



' \t\<n t& 



\t\<n \t\^n 



^ n—l oo 
^ LY^i2qH~2q+l ^Y^^2qH-2q ^ ^-1 ^ ^2qH -2q+l ^ 



t=l t=n 
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Now, we assume that r ^ q — 2 is fixed. We have 

n-l 



E\Ar{n) 



i,j,k/=0 



r+l 



= X] X] c(i/,r,g,a,/3,7,(5)fir,a,/3,7,'5(") 

a,/3^0 7,(5^0 
o+/3=g— r— 1 7+(5=g— r— 1 

where c(-) denotes a generic constant depending only on the objects inside its argument, and 



n-l 



i,j,k/=0 



n-l 



iJ,fc/=0 



>^PH{k-jfpHii-iVpHii-jY. 

When a, P, 7, 6 are fixed, we can decompose the sum ^ ^ ^ appearing in Bj.^a,i3,'y,5{'>T') just 
above, as follows: 



i=j=k=£ i=j=k i=j=£ i=k=£ j=k=£ 
\ £^i k^i jy^i ij^j I 



( 



+ 



i=j,k=£ i=k,j=£ i=£,j=k 
\ kj^i jj^i I 



I 



+ 



E + E + E + E + E + E 



+ E 



1 i=j,k^i i=k,j=^i i=£,k=^i j=k,k=^i j=£,k=^i k=£,k=^i ■ 
\k^£/jLi j^£,kj^£ kj^jjjti kjt£,£^i kj^£,£^i k^jjj^i/ 



i,j,k,£ 
are all different 



(all these sums must be understood as being defined over indices {i,j,k,i} S {0, n — 1}^) 
Now, we will deal with each of these fifteen sums separately. 

The first sum is particularly easy to handle: indeed, it is immediately checked that 



n 2 pH{k 

i=j=k=£ 



\r+l 



PH{i - jr^^PH{k - iTpHik - jfpHii - iVpHii - if ^ 



For the second sum, one can write 



n 



PH{k - ey+'pHii - JY^'pHik - iTpHik - jfpHii - iyPHii - jf 



i=j=k 
£j^i 



n-l 



^ n^^Yp^^^~^f "^^^^JZ^^"^"^" = ^^^ byLemmaOl 

ij^£ £=1 

For the third sum, we can proceed analogously and we again obtain the bound + n?'^^~^'i. 
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For the fourth sum, we write 

PH{k-£Y'-'pH{i-jY^'pH{k-i)yH{k-j)''pH{i-irPH{i-j)' 

i=k=i 



j/j i¥=j 
n-1 



(we used the fact that r + l + /3 + (5^1 since r, /3, 5 ^ 0). For the fifth sum, we can proceed 
analogously and we again obtain the bound + n^^~^. 
For the sixth sum, we have 

Y^pHik- £Y+'pH{i - jY+'pHik - iYpHik - jf Ph{£ - iV Ph{^ - jf 

i=j 
k=t 

^ n-2^/>H(A;-i)2''-2-2- ^n-2^|A:-i|(2«-2-2-)(2//-2) ^ ^-2^1^ _ -14^-4 

k^i k^i k^i 

n-1 

fe=i 

(here, we used r ^ q — 2). For the seventh and the eighth sums, we can proceed analogously 
and we also obtain + for bound. 

For the ninth sum, we have 



PH{k - £Y+'pH{i - JY^'pHik - iYpHik - jfpHii - iVPH{£ - jf 



i=j,k=^i 



k^i 

k^e,ej^i 



Now, let us decompose the sum X^^j-^j j^-^i into 



k>£>i k>i>£ i>i>k i>k>i i>t>k i>k>£ 
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For the first term (for instance), we have 

PH{k-eY'-'pH{k-iy-^-'pH{i-iy-'-^ 

k>£>i 

^ J] (A; - £)(-+l)(2^^-2) _ .)(,-r-l){2H-2) _ .^(,-r-l)(2H-2) 

fc>£>j 

= - £)^(2H-2) _ .^(,-.-l)(2H-2) 

k i<k i<e 



k e<k i<i 
n—1 n—1 

■2H-2 



e=i i=i 

^ n-i(l + n29^-29+i)(l + n2-f^-^) ^n-i+n2-f^-2 since 2^^/ - 2g + 1< 0. 

We obtain the same bound for the other terms. By proceeding in the same way than for the 
ninth term, we also obtain the bound + n^^"^ fgj. j-j^g tenth, eleventh, twelfth, thirteenth 
and fourteenth terms. 

For the fifteenth (and last!) sum, we decompose j ^ e are all different) follows 

E + E +•••• (4-55) 

k>i>i>j k>e>j>i 

For the first term, we have: 

Y PH{k-£Y^'pH{i-jY^'pH{k-irpH{k-jfpH{i-irPH{i-j)' 

k>e>i>j 

^ ^ (^_^)g(2H-2)(._^.)(r+l)(2H-2)(^_ .)(,-r-l)(2i/-2) 

k>e>i>j 

= Y Y^k - ^)9(2/f-2) _ .^(q-.-l)(2H-2) ^( . _ ^.^{.+l)(2/f-2) 

fc £<fc i<£ j<i 

n—1 n—1 n—1 

£=1 i=l j=l 

^ 7^-1(1 + n29^-'''+')(l + n('?-'^-l)(2H-2)+l)(i ^ ^(r-+l)(2//-2)+l) 

^ n-^(l + + n2'?^-29+2) since 2^^^ - 2g + 1< and r + 1, g - r - 1 ^ 1 

^ + , ,2H-2^^2,H-2,+l_ 

The same bound also holds for the other terms in (|4.55p . By combining all these bounds, we 
obtain 

max E\Ar{n)\^ ^ n'^ + n^^-^ + n^^^-^.+i^ 

r=l,...,g— 1 

that finally gives: 

The proof of Theorem 14.11 is now completed by means of Proposition 13.21 □ 
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5 Some remarks about approximations 



The following statement illustrates a natural application of the results about approxi- 
mations (as discussed in Section I3.3|l in order to obtain upper bounds in non-central limit 
theorems for multiple integrals. Observe that we focus on double integrals but, at the cost of 
some heavy notation, everything can be straightforwardly extended to the case of integrals of 
any order q ^ 2. Recall that the class of functions Jifi is defined in formula (I1.14p . 

Proposition 5.1 Let Fn = hifn), 1, where fn G -^®^, be a sequence of double Wiener- 
Ito integrals. Suppose that E{F^) — > 1 and (S>i /n||f)®2 — > as n ^ oo. Then, by 
defining 

Hn = h{fn®fn), n ^ 1, 

one has that 



E 



2 + 2Hn--\\DHn\\l 



0, as n 



oo, 



(5.56) 



and 



2ttE 



2 + 2H„ 



(5.57) 



where N ~ ^(0, 1). 

Proof. First, we have that F„ 
(I2:29]l to deduce that 



Law 



N by Theorem 13.31 Now, use the multiplication formula 



F2-l = 8/2(/„®l/„)+i/„. 



Since 



we infer that Hn 



2 Wfn ®l /nil 



0, 



as n 



oo. 



Law 



1, and therefore that (|5.56|1 must take place, due to Theorem 13. 141 



By the definition of the class ^ , one also deduces that 

d,^,{Fl - 1, iV2 _ 1) ^ d^^{Hn, - 1) +8E\h{fn 01 fn)\- 

The final result is obtained by combining ()3.49|) - (|3.50|) with the relation 



EMfn 01 fn)\ ^ jE{l2ifn ®1 fn?)- 



□ 

We conclude this section with a simple example, showing how one can apply our techniques 
to deduce bounds in a non-central limit theorem, involving quadratic functionals of i.i.d. 
Gaussian random variables. 

Example. Let {Gk)k'^o be a sequence of centered i.i.d. standard Gaussian random variables. 
Also, let (afc)fcgz be a sequence of real numbers such that 

o(0) = 1, a(r) = a(— r), r G Z, and Wii") — 1| < oo. 
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In particular, this implies that a is bounded (say, by ||a||oo)- Set 

n-l 

n 



^ n—l 

Fn = -^a{k-l){GkGi-6ki), n^l. 



k,l=0 

where 6ki denotes the Kronecker symbol. We claim that Fn ^—>- N"^ — 1 with N ~ ^{0, 1), 

n— >oo 

and our aim is to associate a bound with this convergence. Observe first that, without loss 
of generality, we can assume that Gk = B^+i — Bk where i? is a standard Brownian motion 
(that B can be therefore regarded as an isonormal process over S) = L^(M+,dx)). We then 
have 



DFn = -^a{k- /)(Gfcl[z,/+i] + Gil\k,k+i]) 

k,l=0 

SO that 

^ n—l 

\\DFn\\l2 = — a'{k-l)a{i-j){Gkl[i^i+i] + Gil[k,k+i],Gi'i-[j,j+i] + Gjlii^i+i]) 



n 

i,j,k,l=0 
n-l 



^ n—l 

^ a{k- l)a{i - j) {GkGi5ij + GkGjdu + GiGiduj + GiGjdit) 



i,j,k,l=0 

4 

— / ^ GkGi 

kJ=0 



^ n—l 

+^ {a{k - l)a{i - j) - l) {GkGi6ij + GkGjSu + GiGidkj + GiGj6,k) ■ 



Hence 



i,j,k,l=0 

1 



^\\DFJl2-2Fn-2 = An + B„ 



with 

An = - Y {l-a{k-l))GkGi 



2 



n 
fc,/=o 



= A 5^ {a{k-l)aii-j)-l){GkGi6ij+GkGj5u + GiGAj + GiGj5,k) 



We have 



i,j,k,l=0 



A n—l 

4 



^^^n) = ^ {^-ci{k-l)){l-a{i-j))E{GkGiGiG,) 

i,j,k,l=0 



j,fc=0 re2 



On the other hand, we have 



Bn = B^ + bI + B^ + B^ 
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with 



n-l 



2^ ^ ("^^ ~ ^^^^^ ~ ~ ^) '^kGiSij 

i,j,k,l=0 

and similar computations hold for the other terms. Observe that 

^ n— 1 

^ E {(^ik-j)a{i-j)-l)GkG, 



i,j,k=0 



^ E Ofei GkGi, with afci = Zlj^o («(^ " " i) " l) • 



2n2 



i,fc=0 



We have 



n-l 



n-l 



i=o 



Consequently 



i=o 



n-l 



^ {l + \\a\\oo)^\a{r)-l\ 



1 ^ 



i,j,fc,«=0 

Similarly, the same bound holds for E\Bl^\ , i = 2, 3, 4. Finally, by combining all the previous 
estimates, we obtain 



E{-\\DFn\\l, - 2Fn - 2y = 0{1/V^), 



and therefore, by using Theorem EH] and the fact that iV^ _ i 

we deduce that there 

exists a positive constant C > (independent of n) such that 

d^,{G,N^-l)^C/V^, 
where the class J^i is defined in (I1.14p . |-| 



6 An attempt at unification 

In this section, we show that the computations contained in Section 13.11 and Section 13.31 
respectively, in the Gaussian case and the Gamma case, can be unified, by means of the 
general theory of approximations developed by Ch. Stein in [IH Lecture VI]. 

Let Z he a real-valued random variable having an absolutely continuous distribution with 
density p{x), x G M. We make the following assumptions: 

(Al) Z is integrable and centered, that is. 



E\Z\ <oo and E{Z) 



+ 00 



yp{y)dy = 0; 



(6.55 
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(A2) there exist (possibly infinite) numbers a,b such that — oo ^ a < < 6 ^ +00, and the 
support of the density p exactly coincides with the open interval (a, 6), that is, 

p{x) > if, and only if, x G («,&)• (6.59) 



Remark 6.1 At the cost of some heavier notation, one could easily generalize the results of 
this section, in order to accommodate the case of a density p whose support is a union of open 
(and possibly infinite) intervals. 

With a Z verifying assumptions (A1)-(A2), we associate the real-valued mapping r(-), 
defined as 



X ^ t{x) = ^^^-j—^ lxe(a,fe) = lxe(a,6), X G R. (6.60) 



i r yp{y)dy ^ ^ _ /.oo yp{y )dy _ 

p{x) a;e(a,fe) ^^^-j 

Note that r is well-defined on M, due to assumptions (|6.58p - (|6.59p . Also, relation (I6.58P 
implies that t{x) ^ for every x and t{x) > if, and only if, x E {a,b). The following 
result, which is proved in [49], states that, under some additional assumptions, the mapping 
T completely characterizes the density p, and therefore the law of Z. 

Lemma 6.2 (Lemma 3, p. 61 in |49| ) Let the reals a,b be such that —00 ^ a < < b ^ 
+00, and consider a continuous function r(-) ^ on M such that 

t{x) > if, and only if, x G {a,b). (6.61) 

Then, if 

b 

{y/T{y))dy = +00 and / {y/T{y))dy = -00, (6.62) 



there exists a unique (up to sets of zero Lebesgue measure) probability density Pt-{-) on M such 
that the support of Pr exactly coincides with the interval {a,b) and 

/■+°° f~^°° ypr{y)dy 

/ yPT{y)dy = and t{x) = ^ lxe(a,6), x G M. (6.63) 

J— 00 Pt\X) 

The explicit form of p is given by 

rx ydy 

Prix) = ^ X ^^^^ ix£{a,b), X E M, (6.64) 

where C = ^ ^^J^ ^ dx, and we used the notational convention Jq = — whenever x < 0. 

We will see later on that property (I6.62p is verified by the functions r associated with 
densities in the Pearson's family of continuous distributions. Now let X have a density p 
verifying assumptions (A1)-(A2) above, and let r be the mapping given by (|6.60p (for the 
time being, we do not suppose that (I6.62p is verified). We define the Stein operator T^, 
associated with p and r, as the differential operator 

Trf{x) = T{x)f'{x) - xf{x), x£R, (6.65) 
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acting on differentiable functions /. Now fix a function h which is piecewise continuous on M 
and such that E{h{Z)) is well-defined. The Stein equation, associated with p, r and /i, is the 
first order differential equation 

h{x) - E{h{Z)) =Trf{x), x£R, (6.66) 

where Trf is defined in (|6.65p . If r verifies (|6.62p . then (due to Lemma [6?2l) E{Z) = ErQi), 
where Erih) = J h{y)pr{y)dy, and Pr is the density given by (|6.64l) . It follows that, in this 
case, one can rewrite (I6.66P as 

h{x) - Er{h) = Trf{x), X G M, (6.67) 

in order to emphasize the role of r. The next result, whose (rather straightforward) proof 
is once again given by Stein in [l9], states that, under (|6.62|) . the equation (|6.66p admits a 
unique continuous and bounded solution. 

Lemma 6.3 (Lemma 4, p. 62 in |49| ) Let r satisfy 116. 61\) and 16. 62\) . and let Pr be the 

density associated with r via |^7^|). Then, since r has support in {a,b), every solution f of 
116. 67\} must necessarily be such that 

fix) = ^(^)--^^W ^ ^ e h). (6.68) 

Moreover, whenever h is bounded and piecewise continuous, the equation i6.67]} admits a 
unique solution f which is bounded and continuous on {a,b). This unique solution is defined 
by 116. 68\} on M\(a,6), and by 

zdz 

f{x)= / {h{y) - Erih)) — -r-—dy, for every x £ {a,b). (6.69) 

Given a bounded and piecewise continuous function h on M, we define the function Urh as 

r Hx)-EAh) ^ ifxGM\(a,6) 
Urh{x) = { (6.70) 
y f^(h{y)-Er{h)r-^dy, if xe{a,b), 

so that one can rephrase Lemma 1^31 by saying that Urh is the unique solution of (|6.67p which is 
bounded and continuous on (a, b) (note that Urh can be discontinuous only at a or b, whenever 
they are finite). We also record the following consequence of the calculations contained in [491 
formulae (34)-(35), pp. 64-65]: if h is bounded and piecewise continuous, then 

sup [\xUrh{x)\ + \T{x)Urh{x)\] i:6 sup \h{x)\, (6.71) 

a:G(a,b) xG(a,6) 

where Urh = {Urh)' . Note that, due to (I6.68|) . one deduces immediately from (|6.7ip that 

suv[\xUrh{x)\ + \T{x)U'rh{x)W ^ K sw£>\h{x)\, (6.72) 

where K = 2 max{3; 1/a; 1/6} (with 1/ ± oo = 0). The next statement provides a typical 
'Stein-type characterization' of the law of Z . It is a general version of Lemma ll.2l (i) and 
Lemma ll.3r i). 
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Proposition 6.4 Let Z he a random variable having a density p verifying assumptions (Al) 
and (A2). Let t be related to p by ^6.60\) . 

(i) For every differentiable f such that E\T{Z)f' [Z)\ < oo, one has that E\Zf{Z)\ < oo 
and 

E[T^iZ)] = E[T{Z)f\Z) - Zf{Z)] = 0. (6.73) 

(a) Suppose in addition that r verifies 116. 6^) . Let Y be a real-valued random variable with 
an absolutely continuous distribution. Suppose that, for every differentiable f such that 
the mapping x ^ \T{x)f' {x)\ + \xf{x)\ (x G is bounded, one has that 

E[Tr{Y)] = E[T{Y)f\Y) - Yf{Y)] = 0. (6.74) 
Then, Y^= Z. 

Proof. Part (i) is proved in [IH Lemma 1, p. 69]. Part (ii) is a consequence of the fact that, 
if (|6.74p is in order, then (due to (I6.69p - (|6.7ip ). for every bounded and piecewise continuous 
function /i on M, = E[T{Y)U'^h{Y)-YUrh{Y)] = E[h{Y)]- Er{h) = E[h{Y)]- E[h{Z)]. □ 

The following corollary can be proved along the lines of Theorem 13.11 and Theorem 13.111 

Corollary 6.5 Let Z be a random variable having a density p verifying assumptions (Al) 
and (A2). Let r be related to p by h6. 60) . Let F G D^'^ be a smooth functional of some 
isonormal Gaussian process. Assume moreover that E{F) = and the law of F is absolutely 
continuous with respect to the Lebesgue measure. Then, for every bounded and piecewise 
continuous function h, we have 

E{h{F)) - E{h{Z)) = E[T{F){Urh)'{F)- FUrKF)] (6.75) 
= E[{Urh)'{F){T{F)-{DF,-DL~^F)^)\. (6.76) 

Also, 



\E{h{F)) - E{h{Z))\ ^ E[{Urhy{Fffl''E[{T{F) - {DF,-DL-^F)^ffl\ 



(6.77) 



It is not difficult to see that the conclusions of Theorem 13.11 and Theorem 13.111 are indeed 
corollaries of formula (I6.77p . corresponding, respectively, to r(x) = 1 and r(x) = 2(x + z/)+. 
Plainly, a study of general expressions such as the RHS of (|6.77|) would require a fine analysis 
of the properties of the solutions to the Stein equation (|6.66p (similar to the ones performed 
in the Gamma case by Luk and Pickett, respectively, in [26] and [H]). This topic is clearly 
outside the scope of the present paper. However, we conjecture that such a study could be 
successfully performed in the case where the density p belongs to the Pearson's family of 
curves. Indeed, in this case the function r can be neatly characterized in terms of polynomials 
of degree 2. 

To see this, let Z satisfy (A1)-(A2), and let r satisfy (|6.62|) . We say that Z is a (centered) 
member of the Pearson's family of continuous distributions, whenever the density p = Pr (see 
(|6.64p ) satisfies the differential equation 

p'(x) ao + aix , , , 

p{x) bo + hx + b2X^ 
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for some real numbers ao, ai,bo,bi,b2. We refer the reader e.g. to [ISj, Sec. 5.1] for an 
introduction to the Pearson's family. Here, we shall only observe that there are basically 
five families of distributions satisfying (I6.78P : the centered normal distributions, centered 
Gamma and beta distributions, and distributions that are obtained by centering densities of 
the type p{x) = Cx'" exp(— or p{x) = C(l + x)~" exp(/3 arctan(x)) (C being a suitable 
normalizing constant). The next result, proved in [49l Theorem 1, p. 65], states that a 
density belongs to the class of the Pearson's curves if, and only if, its associated mapping r is 
a polynomial of degree ^ 2. The reader is also referred to [46l Sec. 2 and Sec. 4] for several 
related results and explicit computations involving orthogonal polynomials. 

Theorem 6.6 (Stein) Let Z satisfy (A1)-(A2), and let t satisfy 116. 6S\} . Then, the density 
p = Pt is such that t{x) = ax^ + /3x + 7, x S (a, 6) (with a, (3, 7 constants) if, and only if, p 
satisfies ^6. 78\) for every x G (a, b) and for ao = /?, ai = 2a + 1, bo = bi = P and 62 = «■ 

Of course, in order for (I6.62P to be satisfied, one must have that the r(a) = (whenever 
a is finite) and r(6) = (whenever b is finite). As already discussed, the centered Gaussian 
distribution is a member of the Pearson's family, corresponding to the case a = —00, b = +00 
and r(x) = 1. Analogously, a centered Gamma random variable F{u) as in (II. 4p has a density 
of the Pearson type, with characteristics a = —u, b = +00 and r(x) = 2{x + i/)+. 

7 Two proofs 

7.1 Proof of Lemma fTTSl 

Proof of Point (i). One could use directly Proposition 16.41 in the case t{x) = 2(x + z^)+. 
Alternatively, observe first that, for every 1/ > 0, the random variable F*{v) := F{v) + v has 
a non-centered Gamma law with parameter v jl. The fact that 

E{2F\v)f\F\v) - v)\ = E[2{F*{u) - v)f\F*{v))], 

for every / as in the statement, is therefore an immediate consequence of |46l Proposition 
1 and Section 4(2)]. Now suppose that W verifies (I1.13p . By choosing / with support in 
(—00, —v), one deduces immediately that P{W ^ —v) = 0. To conclude, we apply once again 
the results contained in |l6j, to infer that the relations 

P{Wf^-v) = {) and E[2{W + v)f'{W)-Wf{W)]=Q 
imply that, necessarily, W + v ^= F*{u). 

Proof of Point (ii). Fix > 0, consider a function h as in the statement and define hu{y) = 
h{y — u), y > 0. Plainly, hi, is twice differentiable, and \ht^{y)\ ^ cexp{— i/a} expjay}, y > 
(recall that a > 1/2). In view of these properties, according to Luk [26j Th. 1], the second- 
order Stein equation 

h,{y)-E{h,{F*{u)) = 2yg"{y)-{y-u)g'{y), y > 0, (7.79) 

(where, as before, we set F*{v) = F{v) -\- v) admits a solution g such that ||(7'||oo ^ 2||/i'||oo 
and ||(7"||oo ^ ||^"||oo- Since /(x) = g'{x + v), x > —u, is a solution of (I1.12p . the conclusion 
is immediately obtained. 
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Proof of Point (iii). According to a result of Pickett [41], as reported in [43l Lemma 3.1], 
when ^ 1 is an integer, the ancillary Stein equation (|7.79p admits a solution g such that 
1 1 g'' I loo ^ y27r/z^||/i||oo and ||(?"||oo ^ A/27r/i/||/i'||oo- The conclusion is obtained as in the proof 
of Point (ii) . 



7.2 Proof of Theorem [TTSl 

We begin with a technical lemma. 

Lemma 7.1 Let F = /2(/) be a random variable living in the second Wiener chaos of an 
isonormal Gaussian process X (over a real Hilbert space Sj). Then 

E{\\DF\\%) = \e{F'^) + 2E{F'^f. (7.80) 

Proof. Without loss of generality, we can assume that 9) = L'^ {A, £/ , fi) , where {A,£/) is a 
measurable space, and /x is a cr-finite and non-atomic measure. On one hand, thanks to the 
multiplication formula (I2.29|) . we can write 

= hif ® /) + 4/2(/ 01 /) + E{F^). 

In particular, this yields 

L{F^) = -4h{f ^ f) -Shif 01 f). 
On the other hand, (|2.32|) implies that DaF = 2/i(/(-,a)). Consequently, again by (|2.29p : 

\\DF\\l = 4 / h{f{.,a))\{da) 
J A 

= 4/ l2{f{;a)'^f{;a))fi{da) + E{\\DF\\%) 

J A 

= 4/2(/®i/) + 2^(f2), by (1231 and since a)® /(•,a);u((ia) = / 01 /. 

(7.81) 

Taking into account the orthogonality between multiple stochastic integrals of different orders, 
we deduce 

E[\\DF\\l L{F^)]= -32 E\{h{f 01 f)f] = -2 E [\\DF\\l{F^ - E{F^))] . (7.82) 



Finally, we have 



E\\\DF\\%] = E[\\DF\\l{DF,DF),,\ 



E[\\DF\\l{6DF xF- ^6D{F^))] by identity HTm . 

2E[\\DF\\lF^] +^E[\\DF\\lL{F^)] using 6D = -L, 
E[\\DF\\lF^] + E{F^)E[\\DF\\l] using ([Lll, 
Ie{F^) +2E{F^f by (1231. 



□ 
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Now, let us go back to the proof of the first point in Theorem 11.51 In view of Theorem 13.11 it 
is sufficient to prove that 



E 



1 



1 



\DZ. 



n\\f] 



(7.83) 



We have 



E 



1 - - \\DZ, 



l-Ei\\DZX) + ^mDZX) 
1 - 2E{Zl) + \E{Zt) + \E{Zlf 

\{E{Zt) - 3) + {E{Zl) - 1) (\e{zI) - \ 



by (ICTD and (Onll 



The estimate (|7.83p follows immediately. 

Similarly, for the second point of Theorem 11.51 it is sufficient to prove (see Proposition I3.13P 
that 



E 



2Zn-2v- - \\DZn\\% 



^ -\E{Zf,) - l2E{Zl) - + 48Z.I+ I ^ 



By using the relations 



(7.84) 



\E{Zl)-2v\. 



E 



2Zn 



2v - -WDZ, 



AE{Zl) + 4zy2 + -E{\\DZn\\%) - 2E{Zn\\DZn\\l) - 2uE{\\DZn\\l) 
4(1 - u)E{Zl) + 41.2 ^ Ie{Z^) + \E{Zlf - 2E{Zl) by jZM]) and 
{E{Zl) - 2v) (4 - 3Z. + \e{zI)) + i [E{Zt,) - l2E{Zl) - I2u^ + 48i.) , 



the estimate (I7.84p follows immediately. 



□ 
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